Jarzynski Equality with Maxwell's Demon 
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We propose a new thermodynamic equality and several inequalities concerning the relationship be- 
tween work and information for an isothermal process with Maxwell's demon. Our approach is based 
on the formulation a la Jarzynski of the thermodynamic engine and on the quantum information- 
theoretic characterization of the demon. The lower bound of each inequality, which is expressed in 
terms of the information gain by the demon and the accuracy of the demon's measurement, gives 
the minimum work that can be performed on a single heat bath in an isothermal process. These 
results are independent of the state of the demon, be it in thermodynamic equilibrium or not. 
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I. INTRODUCTION 

Ever since the proposition of the "demon" by Maxwell 
[l|, numerous studies have been conducted on the con- 
sistency between the role of the demon and the second 
law of thermodynamics 0. Bennett resolved the appar- 
ent contradiction by considering the logically irreversible 
initialization of the demon Q . The key observation here 
is the so-called Landauer principle [ij which states that, 
in erasing one bit of information from the demon's mem- 
ory, at least ksT \n2 of heat should, on average, be dis- 
sipated into the environment with the same amount of 
work being performed on the demon. Piechocinska has 
proved this principle without invoking the second law in 
an isothermal process Q. 

The essence of consistency between the role of the de- 
mon and the second law of thermodynamics can be il- 
lustrated by the setup of the Szilard engine [f| . Suppose 
that the entire state of the Szilard engine and the demon 
is initially in thermal equilibrium. The demon gains one 
bit of information on the state of the Szilard engine. The 
engine performs just k^,T\n 2 of work by using this infor- 
mation, before returning to the initial state. The demon 
then erases the obtained information from its memory. 
Consequently, the entire state returns to the initial equi- 
librium state. The sum of the work performed on the 
engine and the demon in a full cycle of the Szilard engine 
is non-negative according to the Landauer principle; thus 
the Szilard engine is consistent with the second law in this 
situation. However, the Landauer principle stated above 
tells us nothing if the demon is far from equilibrium in 
the initial and/or final states. 

Further discussions on Maxwell's demon involve 
quantum- mechanical aspects of the demon 0, @, [H, 
EH, E2, EH EH, EH, and general relationships between 
the entropy and action of the demon from a quantum 
information-theoretic point of view [HI, EH • On the other 
hand, the relationship between the work (or heat) and ac- 
tion of the demon is not yet fully understood from this 
viewpoint. We stress that AS = Q/T is not valid in a 



general thermodynamic process. 

Jarzynski has proved an irreversible-thermodynamic 
equality which relates the work to the free energy dif- 
ference in an arbitrary isothermal process (To . E3- 
(exp(-/3W)) = exp(-/3AF), where /3 = (k B T)-\ W is 
the work done on the system, AF is the difference in the 
Helmholtz free energy between the initial and final states, 
and (■ • • ) is the statistical average over all microscopic 
paths. Note that this equality is satisfied even when the 
external parameters are changed at a finite rate. It fol- 
lows from this equality that the fundamental inequality 



(W) > AF 



(1) 



holds. While the original Jarzynski equality is classical, 
quantum-mechanical versions of the Jarzynski equality 
have been studied [H, EH, HH HH . Kim and Qian have 
recently generalized the equality for a classical Langevin 
system which is continuously controlled by a Maxwell's 
demon [Hj]. 

In this paper, we establish a general relationship be- 
tween the work performed on a thermodynamic system 
and the amount of information gained from it by the de- 
mon, and prove the relevant equality and several corol- 
lary inequalities which are generalizations of Eq. fT]). 
With the present setup, the demon performs a quan- 
tum measurement (23l . |24| during an isothermal process, 
selects a sub-ensemble according to the outcome of the 
measurement, and performs unitary transformations on 
the system depending on the outcome. We follow the 
method of Ref. [3, Hj] to characterize the demon only in 
terms of its action on the system and do not make any 
assumption about the state of the demon itself. The sub- 
sequent results therefore hold true regardless of the state 
of the demon, be it in equilibrium or out of equilibrium. 

This paper is constituted as follows. In Sec. II, we 
formulate a general setup of isothermal processes with 
Maxwell's demon and illustrate the case of a general- 
ized Szilard engine. In Sec. Ill, we derive the general- 
ized Jarzynski equality, and new thermodynamic equal- 
ities generalizing inequality (JXJ) . In Sec. IV A, we clar- 
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ify the property of an effective information content ob- 
tained by the demon's measurement. In Sec. IV B, we 
discuss a crucial assumption of the final state of thermo- 
dynamic processes, which sheds light on a fundamental 
aspect of the characterization of thermodynamic equilib- 
rium states. Finally, in Sec. VII, we conclude this paper. 

II. SETUP 

We consider an isothermal process at temperature 
T = (fee/?) -1 , in which a thermodynamic system is in 
contact with an environment at the same temperature, 
and in which the initial and final states of the entire sys- 
tem are in thermodynamic equilibrium. We do not, how- 
ever, assume that the states in the course of the process 
are in thermodynamic equilibrium. We treat the isother- 
mal process as the evolution of thermodynamic system S 
and sufficiently large heat bath B, which are as a whole 
isolated and only come into contact with some external 
mechanical systems and a demon. Apart from the de- 
mon, the total Hamiltonian can be written as 

H s+B (t)=H s {t) + H iut (t) + H B , (2) 

where the time dependence of H s (t) describes the me- 
chanical operation on S through certain external param- 
eters, such as an applied magnetic field or volume of 
the gas, and the time dependence of H lnt (t) describes, 
for example, the attachment of an adiabatic wall to 
S. We consider a time evolution from t\ to tf, assume 
H' lnt (ti) = H int (t f ) = 0, and write H S+B {U) = H { and 
H s+B (tf) — Hf. We consider the simplest isothermal 
process in the presence of the demon. This process can 
be divides into the following five stages: 

Stage 1. — At time ti, the initial state of S+B is in ther- 
mal equilibrium at temperature T. The density operator 
of the entire state is given by 

Pi = 7} > z i = tr{exp(-/3 J ff i )}. (3) 

Note that the partition function of S+B is the product of 
that of S and that of B: Z x = ZfZf, and the Helmholtz 
free energy of S+B is the sum F\ = + F B , where 
Fi = -fc B TlnZi, etc. 

Stage 2. — From ti to ti, system S+B evolves according 
to the unitary transformation represented by 

L/i = TexpQ-jH H s+B (t)dty (4) 

Stage 3. — From t\ to ti, a demon performs a quantum 
measurement described by measurement operators {Mk} 
on S and obtains each outcome k with probability pk- 
Let K be the set of all the outcomes k satisfying p k ^ 0. 
Suppose that the number of elements in K is finite. The 
process proceeds to stage 4 only if the outcome belongs to 
subset K 1 of K, otherwise the demon discards the sample 



and the process restarts from stage 1 ; we calculate the 
statistical average over subensemble K' . 

Stage 4- — From t% to £3, the demon performs a mechan- 
ical operation on S depending on outcome k. Let Uk be 
the corresponding unitary operator on S+B. We assume 
that the state of the system becomes independent of k 
at the end of this stage, this being a feature characteriz- 
ing the action of the demon [14| . This stage describes a 
feedback control by the demon. Note that the action of 
the demon is characterized only by set {K 1 , M k , Uk}- 

Stage 5. — From i 3 to tf, S+B evolves according to uni- 
tary operator Uf which is independent of outcome k. We 
assume that S+B has reached equilibrium at tempera- 
ture T by tf from the macroscopic point of view because 
the degrees of freedom of B is assumed to far exceed that 
of S. The partition function of the final Hamiltonian is 
then given by 

Z t = tr{exp(-/3if f )}. (5) 

As in stage 1, it follows that Zf = ZfZf and Ff — 
F f s + FP, where F B = F f B . We denote as p t the den- 
sity operator of the final state. 

After going through all the stages, the state of the 
system changes from p\ to 

Pi = I E ^ E l ( fi ) 

P k£K' 

where Ek is given by 

E k = U f U k M k U u (7) 

and p is the sum of the probabilities of fc's belonging to 
K' as 

p=j2 t < E i E kpi)- (8) 

keK' 

Note that E k is a nonunitary operator because it involves 
the action of measurement by the demon. In contrast, in 
the original setup of Jarzynski, there is no demon and 
hence E k is unitary. 

In the case of a generalized Szilard engine, the forego- 
ing general process can be illustrated as follows. We use 
a box containing a single molecule localized in a region 
that is sufficiently smaller than the box. This molecule 
interacts with a heat bath at temperature T. 

Stage 1. — A molecule is initially in equilibrium at tem- 
perature T . Let pi be the density operator of the initial 
state of the engine and the heat bath. 

Stage 2. — We divide the box into n partitions of equal 
volume. The state of the molecule then becomes p\ = 
(p(l) + p{2) + • • • + p(n))/n, where p(k) represents the 
state of the molecule in the fcth partition. We set K — 
{ I • 2. • • • . // 1 . 

Stage 3. — A demon performs a measurement on the 
system to find out where the molecule is. The demon 
chooses subset K' — {1,2,--- , m} (m < n), and the 
process proceeds to stage 4 only if outcome k belongs to 
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FIG. 1: A generalized Szilard engine with n — 5 and m — 3. 
The conventional Szilard engine corresponds to n = m = 2. 
Stage 1. — The state of the engine and the heat bath is initially 
in thermodynamic equilibrium. Stage 2. — Divide the box into 
5 partitions. Stage 3. — A demon measures which partition 
the molecule is in. This measurement is described by mea- 
surement operators {Mi, M2, ■ ■ • , Afs}. Stage 4- — The demon 
performs operation Uk depending on measurement outcome 
k. If k = 1, 2 or 3, the demon moves the fcth box to the left- 
most position. If the outcome is 4 or 5, the demon discards 
the sample and the process restarts from stage 1. Stage 5. — 
The box is expanded quasi-statically and isothermally so that 
the final state of the entire system returns to the initial state 
from a macroscopic point of view. This process is a unitary 
evolution of the entire system. See the text for details. 



K'. The state of the system is p 2 = (/o(l) + p(2) + ■ ■ ■ + 
p(m))/m at the end of this stage. 

Stage 4- — When the outcome is k (e K'), the demon 
removes all but the fcth box, and then moves the kth 
box to the leftmost position. This operation is described 
by U k . The state of the molecule after this operation is 

P3 = Po- 
stage 5. — We expand the box quasi-statically and 
isothermally so that the final state of the entire system 
returns to the initial state from a macroscopic point of 
view. Here by the last sentence we mean that the ex- 
pectation value of any macroscopic quantity in the final 
state is the same as that in the initial state, as will be 
discussed in detail in Sec.VIB. This process is unitary 
in respect of the molecule and heat bath; we can thus 
describe this process by unitary operator Uf. 

Figure[T]illustrates these processes for the case of n = 5 
and m = 3. When n = m = 2, this process is equivalent 
to the conventional Szilard engine. 



III. EQUALITY AND INEQUALITIES 

Let us now prove the equality which constitutes the 
main result of this paper. Let W be the work performed 
on S+B during the entire process, {E^} and {l^a)} be 
the respective eigenvalues and eigenvectors of Hi, and 
{E l b } and {IV'ft)} the respective eigenvalues and eigenvec- 



tors of H{. We can then calculate the statistical average 
[3 H of exp(-/W) over the subensemble specified by 
condition k € K' as 



(exp{-pW)) K ' 
1 ^ e -0K 

P 



E 



a.b.keK' 



\(MEkWa)\ 2 e 



b,k£K< 



= 5- Y, (4>b\UfU k M k Miuiul\^ b 
Zj\ p — 



(9) 



where p is given by Eq. ([S]) . Making the polar decompo- 
sition of Mfe as Mfc = Vky/Dk, Dk = MtMu, where 14 
is a unitary operator, we can rewrite Eq. ([9]) as 

{exp(-0W)) K > = ~ V tr{D k vlUpl P T n UiJ k V k ), (10) 

where p^ an is the density operator of the canonical dis- 
tribution of the final Hamiltonian: 



can 
Pi 



exp(-/?ff f ) 



(11) 



Let p\ be the density operator just before the mea- 

(k) 

surement, and p 2 be that immediately after the 

( k ) 

measurement with outcome k. We obtain p 2 = 
M k piM£/ix(D h pi) and p [ 2 k) = u\u} Pi U { U k ; therefore 



vlulu} Pf u t u k v k 



tr(£> fe pi) 



Thus Eq. HQI reduces to 



Zi p V v 



where we introduced the notation 



E 

k £K 



, tr(D k pi) 



E 



tv((4E k ) 2 pi) 



tT(ElE kPi ) 



A V =Y^ tr(D k v2utu}(pt- P T n )UiU k V k ). 



(12) 
(13) 

(14) 
(15) 



keK' 



The parameter r\ describes the measurement error of the 
demon's measurement, the precise meaning of which is 
discussed in Sec. V. We now assume that the final state 
Pi satisfies 



Ai] = 0. 



(16) 



We discuss in detail the physical meaning and validity of 
this assumption in Sec. IV B. Note that if the density 
operator of the final state is the canonical distribution, 
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i.e. pf = Pf an , then the above assumption (fT6)) is trivially 
satisfied. Under this assumption, we finally obtain 



(exp(-pW)) K > = exp -/3AF + In 



<1 



(17) 



where AF = F{ — Fj = F f s — F ; s . This is the main result 
of this paper. 

In a special case in which F/^'s are projection operators 
for all k, and K' = K, Eq. ([TT]) reduces to 



(exp(-/3W)) = exp (-0AF + hid) . 



(18) 



where d is the number of elements in K . Note that the 
right-hand side of Eq. (TT8|) is independent of the details 
of pre- measurement state p\. 

We can apply the generalized Jarzynski equality to 
prove an inequality. It follows from the concavity of the 
exponential function that 



exp(-/3<WV) < (exp(-0W)) K > 
we therefore obtain 

V 



(W)k' > AF -k B T In- 



P 



(19) 



(20) 



Consider the case in which the demon selects single 
outcome k, that is K' — {k}. Equation then reduces 
to (exp(-/3W)) k = exp(-/3AF + (rjk/Pk)), where r/ k = 
tr(£>^pi)/tr(Dfepi), and inequality (|20|) becomes 

{W)k > AF — fceTln — . (21) 
Pk 

Averaging inequality (|2"Tj) over all k £ K , we obtain 

(W) > AF — k B TH cS , (22) 

where 

" (23) 



2T*= In 2*. 



describes an effective information content which the de- 
mon gains about the system. Inequality (|22p is a gener- 
alization of (UJ and is stronger than (j2"0|) . It shows that 
we can extract work larger than — AF from a single heat 
bath in the presence of the demon, but that we cannot 
extract work larger than k-g,TH cS — AF. 



IV. DISCUSSIONS 
A. Effective Information Content 

We discuss the physical meaning of r\k and H cS . It can 
easily be shown that 



Pk <rik < 1- 



(24) 



Here pk = tjk for all p\ if and only if Dk is proportional 
to the identity operator, and rjk = 1 for all p\ if and only 



if Dk is a projection operator. In the former case, the 
demon can gain no information about the system, while 
in the latter case, the measurement is error-free. Let us 
consider the case of Dk = Pk + ePi (I ^ k), where Pk 
and Pi are projection operators and e is a small positive 
number. Then rjk is given by 



rjk 



tr(U fc pi) 



1 



MPipi) 
'ti-(PkPi) 



o(e). 



(25) 



We can therefore say that 1 — rjk is a measure of distance 
between Dk and the projection operator. It follows from 
(1241 that 



< H cB < H 



(26) 



where H is the Shannon information content that the 
demon obtains: H = — J2k£KPk ^ n Pk- 

We now derive some special versions of inequality (j22l) . 
If the demon does not get information (i.e., H cS = 0), 
inequality (|22|) becomes (W) > AF, which is simply in- 
equality (JlJ. On the other hand, in the case of a pro- 
jection measurement, where H cS = H, (|2"2"|) becomes 
(W) > AF — k B TH. An inequality similar (but not 
equivalent) to this inequality has been proved by Kim 
and Qian for a classical Langevin system [22l |. 



B. Characterization of Thermodynamic 
Equilibrium States 

We next show the physical validity of the assump- 
tion ([To]). 

In general, the canonical distribution describes the 
properties of thermodynamic equilibrium states. How- 
ever, the thermodynamic equilibrium is a macroscopic 
property characterized only by the expectation values 
of macroscopic quantities. In fact, to show that a heat 
bath is in thermodynamic equilibrium, we do not observe 
each molecule, but observe only macroscopic quantities 
of the heat bath, for example the center of mass of a 
"small" fraction involving a large number (e.g. ~ 10 12 ) 
of molecules. Thus a density operator corresponding to 
a thermodynamic equilibrium state is not necessarily the 
rigorous canonical distribution; pf = /3j an is too strong 
an assumption. 

Note that no assumption has been made on the final 
state pi in the derivation of the orig inal Jarzynski equal- 
ity without Maxwell's demon [16l |. so (exp(— (3W)) = 
cxp(— (3AF) holds for any final state pi. Under the con- 
dition that the final state of S+B is in thermodynamic 
equilibrium corresponding to the free energy Ff from 
a macroscopic point of view, we can interpret inequal- 
ity UJ, which can be shown from the Jarzynski equality, 
as the thermodynamic inequality for a transition between 
two thermodynamic equilibrium states, even if pf is not 
a rigorous canonical distribution. 

On the other hand, we have required the supplemen- 
tary assumption (|16|) for the final state pf to prove the 
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generalized Jarzynski equality with Maxwell's demon. 
The assumption (TT6"]) holds if 



tv(D kPl ) = tr{D k pf 



(27) 



for all k in K' , where D k = U { U k V k D k V k f Ulul We 
can say that under the assumption (|16p. pf is restricted 
not only in terms of macroscopic quantities, but also con- 
strained so as to meet Eq. ([27]) . It appears that the latter 
constraint is connected with the fact that the system in 
state pf and that in state p\ an should not be distinguished 
by the demon. 

We stress that our assumption (|16p is extremely weak 
compared with the assumption pf = pj an . To see this, we 
denote as / the degree of freedom of S+B (e.g. / ~ 10 23 ), 
as N the dimension of the Hilbert space corresponding 
to S+B, and as d! the number of elements in K' . We 
can easily show that N > 0{2$). On the other hand, 
d! = 0(1) holds in a situation that the role of the demon 
is experimentally realizable. For example, suppose that S 
is a spin-1 system and B consists of harmonic oscillators, 
and the demon made up from optical devices performs a 
projection measurement on S. In this case, dl < d = 3 
and N = oo. The rigorous equality pi — Pf an holds, 
in general, if and only if all the matrix elements in pi 
coincides with that of Pf an , and note that the number 
of independent real valuables in the density operators is 
N 2 — 1. On the other hand, only d! equalities in (|27|) are 
required to meet the assumption Ar/ = 0. 

Although it is a conjecture that the assumption (fT6|) 
is virtually realized in real physical situations, we believe 
that it is indeed realized in many situations. A more 
detailed analysis on the assumption (TTB]) is needed to 
understand the concept of thermodynamic equilibrium. 

Finally, we consider the case that the assumption (fl6|) 
is not satisfied and 



tr 



p c r: 



holds for all k in K'. 

IA77/77I as 



We can then estimate the value of 



A77 
V 



d! 
< —£■ 
P 



(29) 



Thus the deviation from the generalized Jarzynski equa- 
tion is bounded only by the difference on the left-hand 
side of Eq. fl28]). 



< e 



(28) 



V. CONCLUSION 

In conclusion, we have generalized the Jarzynski equal- 
ity to a situation involving Maxwell's demon and derived 
several inequalities in thermodynamic systems. The de- 
mon in our formulation performs a quantum measure- 
ment and a unitary transformation depending on the 
outcome of the measurement. Independent of the state 
of the demon, however, our equality (fT8|) establishes a 
close connection between the work and the information 
which can be extracted from a thermodynamic system, 
and our inequality l|22p shows that one can extract from 
a single heat bath work greater than —AF due to an ef- 
fective information content that the demon gains about 
the system. To analyze broader aspects of information 
thermodynamic processes merits further study. 
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